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(54) Image processing apparatus for print process of photographed image 



(57) An image processing method of performing 
various image correction processes to a photographed 
image and printing the photographed image comprises 
the steps of: inputting image information to which pho- 
tographing condition information is added; analyzing the 
characteristic of the input image information; performing 
an image correction process of improving image quality 
to the photographed image on the basis of the charac- 



teristic of the analyzed image information; discriminat- 
ing the photographing condition information added to 
the photographed image; and determining an image 
correction process to be performed in a step of perform- 
ing the image correction process on the basis of the pho- 
tographing condition information discriminated in the 
discriminating step, whereby it becomes possible to pro- 
vide a high quality print-output result of reflecting the in- 
tention of a user at a time of photographing. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention relates to an image cor- 
rection process for print-outputting, by a printer, digital 
image data obtained in a photographing operation by a 
digital still camera or the like. 

Related Background Art 

[0002] In recent years, with the spread of a digital still 
camera, digitization of photographed images comes into 
popular use. Especially, an opportunity of treating pho- 
tographic images as digital image data on a personal 
computer increases. Furthermore, processing and edit- 
ing can be easily performed to the digital image data 
being the photographic images by using various appli- 
cation software on the personal computer. 
[0003] On the other hand, the technology in a full- 
color hardware copy is also rapidly progressed. Espe- 
cially, in the print technology according to an ink jet sys- 
tem, image quality in a print-output result obtained by 
that system becomes the same as that in a print-output 
result obtained by a silver salt photographic method ow- 
ing to improvement on technology of reducing granular- 
ity due to ink dots. Moreover, since the print technology 
according to the ink jet system is comparatively easy, 
this system has been widely spread. 
[0004] According to such a technical background as 
above, it is required that the digital image data obtained 
by a photographing operation performed by the digital 
still camera can be easily print-output. With respect to 
an image correction process to be performed when im- 
age data is print-output, by using application software 
on the personal computer instead of performing a man- 
ual image correction process of using complicated func- 
tions, necessity of an automatic image correction proc- 
ess of always obtaining excellent images, to which the 
image correction process was performed, increases. 
[0005] Therefore, in order to obtain an excellent print- 
output result, as a method of performing an image proc- 
ess such as the image correction process to image data 
and then print-outputting the processed data, there pro- 
posed various methods such as, for example, a method 
of analyzing a scene of a photographed image and au- 
tomatically performing image correction on the basis of 
the analyzed result, and the like. 
[0006] For example, there proposed a method related 
to so-called "density correction" being image correction 
of preventing an over-bright state (intensive pale color) 
or an over-dark state (intensive deep color) of a printed 
image when a photographed image is print-output. Also, 
there proposed a method related to so-called "image 
correction" of correcting an unp referable image due to 
color fogging, defective exposure (defective lightness or 



defective contrast), defective saturation or the like on 
the photographed image and an image of defective color 
balance due to the color fogging or the like. 
[0007] In either the image processing methods of 
5 "density correction" and "image correction", as the 
structure for the purpose of automatic image correction, 
such the structure characterized in that a histogram of 
accumulating the number of pixels of a target brightness 
value to each brightness value of a brightness signal in 

10 an image (original image) to be processed is used to 
analyze the original image, which is corrected on the ba- 
sis of the analyzed result, is employed. 
[0008] As functions of the digital still camera, not only 
a function of recording image data obtained by a photo- 
's graphing operation in a storage medium such as a mem- 
ory card or the like as digital image data but also a func- 
tion of recording additional information of indicating a 
photographing condition at a time of photographing in 
the storage medium together with the digital image data 

20 can be realized. 

[0009] Incidentally, in the above conventional image 
processing method, in case of analyzing a scene of a 
target image by analyzing an image to be processed 
(target image) obtained by a photographing operation 

25 performed by the digital still camera and performing the 
automatic image correction of the target image based 
on the analyzed result, such the automatic image cor- 
rection of printing an image (standardized image) theo- 
retically considered as the optimum one for all the target 

30 images is to be performed basically. 

[0010] However, in case of performing the above au- 
tomatic image correction, correction against the inten- 
tion of a user at a time of obtaining a target image (time 
of performing a photographic operation) is sometimes 

35 performed. 

[0011] For example, for an image obtained by per- 
forming a photographing operation under an exposure 
condition intended by the user to increase or decrease 
lightness of the image, if the image is light, it is corrected 

40 to slightly decrease the lightness, and if the image is 
dark, it is corrected to slightly increase the lightness. 
That is, even if the target image is any kind of image, 
the image is corrected as one of standard lightness and 
is output. 

45 [0012] Furthermore, for an image to which a specific 
effect has been aimed by intentionally varying white bal- 
ance of the digital still camera by the user, image cor- 
rection of obtaining the optimum color balance is per- 
formed similar to a case for an image which was ob- 

50 tained by an ordinary photographing operation. 

[0013] On the other hand, although the digital still 
camera has a function of a photographing mode which 
obtains the optimum photographing condition for a 
scene to be photographed, a method of determining an 

55 image correction condition based on the photographing 
mode is considered. If information of a photographed 
scene is previously recognized, that is, if it is the photo- 
graphed scene of scenery, person or the like is previ- 
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ousty recognized, it is considered that correction of 
achieving more precise and preferable images can be 
realized. 

[0014] However, actually, since it is impossible to 
surely judge that the photographed scene corresponds 
to what kind of scene from the analyzed result of the 
target image which was obtained by photographing, on- 
ly such a countermeasure has been found in a prior art, 
wherein the corrected effect according to the automatic 
image correction is weakened so that the harmful effect 
for an image does not occur. 

[001 5] With the advance of functions of the digital still 
camera in recent years, for example, there finds such a 
camera in which a specific effective function of increas- 
ing saturation or variably changing contrast or lightness 
for an image obtained by a photographing operation is 
provided. However, if an image correction process is 
performed to an image, to which the specific effective 
function is used, there sometimes occurred a case of 
deteriorating quality of the processed image due to a 
fact that a specific effect by the specific effective function 
is lost or correction by the specific effective function be- 
comes intensive owing to double corrections. 

SUMMARY OF THE INVENTION 

[001 6] An object of the present invention is to provide 
an image processing apparatus and an image process- 
ing method of eliminating the above drawbacks. 
[0017] Another object of the present invention is to 
provide an image processing method and an image 
processing apparatus capable of printing an image of 
which quality is intended by a photographer. 
[0018] Still another object of the present invention is 
to provide an image processing method and an image 
processing apparatus capable of performing a print 
process by effectively utilizing photographing condition 
information added to an photographed image. 
[0019] Still another object of the present invention is 
to provide an image processing method and an image 
processing apparatus capable of appropriately perform- 
ing automatic correction at a time of printing an image. 
[0020] Other objects of the present invention will be- 
come apparent from the description based on the fol- 
lowing attached drawings and appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0021] 

Fig. 1 is a block diagram showing the structure of 
an image printing system to which the present in- 
vention is applied in the first embodiment; 
Fig. 2 is a view for explaining image data to be proc- 
essed in the image printing system; 
Fig. 3 is a flow chart for explaining an operation of 
an image processing apparatus in the image print- 
ing system; 



Fig. 4 is a view for explaining the image data in the 
second embodiment; 

Fig. 5 is a flow chart for explaining an operation of 
the image processing apparatus in the second em- 

5 bodiment; 

Fig. 6 is a block diagram showing the structure of 
an image printing system to which the present in- 
vention is applied in a third embodiment; 
Fig. 7 is a view for explaining an example of a dis- 

to play screen in the image printing system; and 

Fig. 8 is a block diagram showing the structure of a 
computer which reads programs for causing the 
computer to realize functions of the image printing 
system from a computer-readable storage medium 

15 and executes the programs. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

20 [0022] Hereinafter, the embodiments of the present 
invention will be explained with reference to the accom- 
panying drawings. 

(First Embodiment) 

25 

[0023] The present invention is applied to, e.g., an im- 
age printing system 100 as shown in Fig. 1 . The image 
printing system 100 is structured to realize precise au- 
tomatic image correction and provide a printed result of 
30 a high quality photographic image of further reflecting 
the intention of a user at a time of photographing by au- 
tomatically performing image correction on the basis of 
an analyzed result of information (additional informa- 
tion) indicating a photographing condition added to im- 
35 age data to be processed obtained by a photographing 
operation performed by a digital still camera 1 01 , to the 
image data. 

[0024] Hereinafter, the structure and operation of the 
image printing system 1 00 according to the present em- 
^0 bodiment will be concretely explained. 

<Structure of Image Printing System 100> 

[0025] The image printing system 1 00 is structured to 
45 include the digital still camera 1 01 , an image processing 
apparatus 108 and a printer 115. 
[0026] The digital still camera 1 01 , which obtains pho- 
tographed image data 107 by a photographing opera- 
tion performed by a user and outputs image data 105 
so which includes photographing condition data 1 06 (addi- 
tional information) in the photographing operation and 
the photographed image data 1 07 to the image process- 
ing apparatus 108, has a photographing condition set- 
ting unit 102, a photographing condition recording unit 
55 103 and a photographed image recording unit 104. 
[0027] The photographing condition setting unit 102 
sets various photographing conditions necessary for the 
photographing operation. The photographing condition 
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recording unit 103 records the photographing condition 
data 1 06 set by the photographing condition setting unit 
102 into the image data 105 (data to be output to the 
image processing apparatus 108). 

[0028] The photographed image recording unit 104 5 
records the photographed image data 107 into the im- 
age data 105 in accordance with a photographing con- 
dition set by the photographing condition setting unit 
102. 

[0029] As a supplying method of supplying the image 10 
data 1 05 to the image processing apparatus 1 08, for ex- 
ample, a method of transferring data through a commu- 
nication line such as a USB (Universal Serial Bus) orthe 
like, a method of recording image data into a recording 
medium mounted on the digital still camera and deliver- 15 
ing the recording medium or another method is applica- 
ble. 

[0030] The image processing apparatus 1 08 which is, 
for example, composed of a personal computer per- 
forms an image correction process to the photographed 20 
image data 1 07 in the image data 1 05 sent from the dig- 
ital still camera 1 01 according to activation of predeter- 
mined application software and a printer driver to per- 
form print output by a printer 115. 

[0031] Thus, the image processing apparatus 108 25 
has a reader unit 109, a data analysis unit 110 which 
includes a photographing condition analysis unit 111 
and a photographed image analysis unit 112, an image 
correction processing unit 113 and a print data conver- 
sion unit 114. Each function of the respective structural 30 
units 1 09 to 11 4 is realized by the activation of the pre- 
determined application software and the printer driver. 
[0032] The reader unit 1 09 reads the image data 1 05 
sent from the digital still camera 101 . 

[0033] The data analysis unit 110 analyzes the pho- 35 
tographing condition data 1 06 included in the image da- 
ta 1 05 obtained by the reader unit 1 09 using the photo- 
graphing condition analysis unit 111 and analyzes the 
photographed image data 107 obtained by the reader 
unit 1 09 using the photographed image analysis unit 112 40 
then selects an image correction algorithm on the basis 
of the analyzed result. 

[0034] The image correction processing unit 1 1 3 per- 
forms the image correction process to the photographed 
image data 1 07 according to the image correction algo- 4s 
rithm selected in the data analysis unit 110. 
[0035] As to selection (determination) of the image 
correction algorithm, for example, in a case where the 
photographed image analysis unit 112 analyzes a 
brightness value or a brightness distribution from a sig- so 
nal value of the photographed image data 1 07, the char- 
acteristic of the photographed image data 1 07 is recog- 
nized by the analyzed result, and the optimum correc- 
tion condition corresponding to the recognized result is 
determined. Then, an image correction algorithm based 55 
on the determined condition is selected. 
[0036] That is, selection of the final image correction 
algorithm is determined by an algorithm determined 
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from the analyzed result of the photographing condition 
data 106 by the photographing condition analysis unit 
1 1 1 and an algorithm determined from the characteristic 
recognition of the photographed image data 1 07 by the 
photographed image analysis unit 112. 
[0037] As the image correction process, a brightness 
correction process, a contrast correction process, a 
color correction process, a saturation correction proc- 
ess, a smoothing process, an edge emphasis process, 
a noise reduction process or the like is enumerated. 
However the image correction process is not limited to 
the above. 

[0038] The print data conversion unit 1 1 4 converts the 
photographed image data 107 corrected in the image 
correction processing unit 113 into appropriate format 
data (e.g., C } M 7 Y and K data) which can be printed in 
the printer 115 and transfers the converted data to the 
printer 115 through a predetermined interface. 
[0039] Then, the printer 115 print-outputs the data 
transferred from the print data conversion unit 1 1 4 in the 
image processing apparatus 108. 
[0040] As the printer 115, an ink jet system printer or 
the like of a serial scanning type is applicable. 
[0041 ] In the present embodiment, the functions of the 
structural units 109 to 114 included in the image 
processing apparatus 108 are realized by activation of 
the application software operating on the personal com- 
puter. However, realizing of the functions is not limited 
to the above case but may be realized by, e.g., hard- 
ware. More particularly, the functions may be realized 
by form of a driver of the printer 115. 
[0042] For example, in case of using the personal 
computer as the image processing apparatus 108, the 
image data 105 is stored in a storage medium such as 
a hard disk or the like in the image processing apparatus 
108 or stored in a storage medium of another personal 
computer (including a server or the like) connected to 
the image processing apparatus 108, and then the 
stored image data may be processed in the image 
processing apparatus 108. 

[0043] As to transfer of the image data 105 from the 
digital still camera 1 01 to the image processing appara- 
tus 1 08 (in case of using the personal computer as the 
image processing apparatus 108, it is an inner storage 
medium or the like), a method of utilizing an arbitrary 
communication line orthe recording medium is applica- 
ble as above. However, more particularly, a card reader, 
a cable connection, an infrared communication or a 
wireless communication is applicable. In this case, for 
example, the digital still camera 101 is connected with 
the image processing apparatus 108 by the cable con- 
nection, the infrared communication or the wireless 
communication, and it may be structured that the image 
processing apparatus 1 08 directly reads the image data 
105 from a memory card, a built-in memory or the like 
held in the digital still camera 101. 
[0044] As the form of the image printing system 1 00, 
for example, it may be structured that the function of the 
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image processing apparatus 1 08 is to be provided in the 
printer 115. In this case, the personal computer or the 
like has not to be used as the image printing system 1 00. 
Furthermore, in this case, for example, the image data 
105 may be read in the printer 115 by data reading 
means (corresponding to the function of the reader unit 
109) such as the card reader or the like provided in the 
printer 115 through the recording medium such as the 
memory card or the like. Besides, the digital still camera 
101 is connected with the printer 115 by a wired cable, 
the infrared communication or the wireless communica- 
tion, and it may be structured that the printer 115 reads 
the image data 105 from the memory card, the built-in 
memory or the like held in the digital still camera 101. 

<Format of Image Data 105> 

[0045] The format of the image data 1 05 means a re- 
cording format in case of recording the image data 1 05 
in an arbitrary recording medium or a format in case of 
transferring the image data 1 05 to the image processing 
apparatus 108 in the digital still camera 101. 
[0046] The image data 1 05 is, for example, structured 
by a tag area 1 06a being a recording area of the photo- 
graphing condition data 1 06 and a photographed image 
data area 107a being a recording area of the photo- 
graphed image data 107. 

[0047] As the image data 1 05, it may be data in a com- 
pressed format state or data of an uncompressed for- 
mat. In case of compressing the image data 1 05, partial 
compression may be performed in a manner that the 
photographing condition data 106 is not compressed 
and the photographed image data 1 07 is compressed. 
As a color space of the photographed image data 107, 
RGB data or YCC (brightness color difference) data may 
be used. For example, when the YCC data is to be used 
as the photographed image data 1 07, a conversion from 
the YCC data to the RGB data is performed in the reader 
unit 109 in the image processing apparatus 108. 
[0048] In the tag area 1 06a of the image data 1 05, the 
photographing condition data 106 is recorded in a por- 
tion of offsetting a predetermined data amount form a 
head of the area. The photographing condition data 1 06 
(photographing condition information of the digital still 
camera 101) corresponds to data regarding exposure, 
a stroboscope, white balance, a photographing mode 
and the like, and format of the data can be held in com- 
mon between the digital still camera 101 being a data 
input side and the printer 1 1 5 being a data output side. 
[0049] As the photographing condition data 1 06, it in- 
cludes information of ID = 0 to 3 as shown in Fig. 2. 
[0050] The information of ID = 0 (offset = n) indicates 
information regarding the exposure. 
[0051] For example, in the digital still camera 101, 
when the photographed image data 107 is obtained by 
a photographing operation according to an automatic 
exposure mode, in the corresponded photographing 
condition data 1 06, a parameter "0" is set for ID = 0. On 



8 

the other hand, when the photographed image data 107 
is obtained by a photographing operation according to 
a manual exposure mode, in the corresponded photo- 
graphing condition data 106, a parameter "I" is set for 
5 ID = 0. 

[0052] The information of ID = 1 (offset = n + 1 ) indi- 
cates information regarding the stroboscope. 
[0053] For example, in the digital still camera 101, 
when the photographed image data 1 07 is obtained in 
10 a state that the stroboscope does not flash, in the cor- 
responded photographing condition data 106, a param- 
eter "O" is set for ID = 1. On the other hand, when the 
photographed image data 1 07 is obtained in a state that 
the stroboscope flashes, in the corresponded photo- 
ns graphing condition data 1 06, a parameter "1" is set for 
ID = 1. 

[0054] The information of ID = 2 (offset = n + 2) indi- 
cates information regarding the white balance. 
[0055] For example, in the digital still camera 101, 

20 when the photographed image data 1 07 is obtained in 
a state of an automatic white balance mode, in the cor- 
responded photographing condition data 106, a param- 
eter "0" is set for ID = 2. On the other hand, when the 
photographed image data 107 is obtained in a state of 

25 a manual white balance mode, in the corresponded pho- 
tographing condition data 106, a parameter "1" is set for 
ID = 2. 

[0056] The information of ID = 3 (offset = n + 3) indi- 
cates information regarding the photographing mode. 

30 [0057] For example, in the image processing appara- 
tus 108, when an image correction process in case of 
print-outputting the photographed image data 1 07 is in- 
hibited, a parameter "0" indicating "effect inhibition" is 
set for ID = 3, This parameter is set when an image ed- 

35 iting process was performed in the digital still camera 
101. On the other hand, in the image processing appa- 
ratus 108, when the image correction process in case 
of print-outputting the photographed image data 107 is 
made to be effective, a parameter "1" indicating "stand- 

40 ard" is set for ID = 3. In the digital still camera 101 , when 
the photographed image data 107 is obtained by a 
"scenery 0 mode, a parameter "2" is set for ID = 3. In the 
digital still camera 1 01 , when the photographed image 
data 107 is obtained by a "person" mode, a parameter 

45 "3" is set for ID = 3. 

<Operation of Image Processing Apparatus 108> 

[0058] Fig. 3 shows an operation of the image 
50 processing apparatus by a flow chart. 

Step S201 : 

[0059] The reader unit 1 09 reads the image data 105 
55 to be printed. 
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Step S202: 

[0060] The data analysis unit 1 1 0 analyzes the infor- 
mation of ID = 0 (exposure information) in the photo- 
graphing condition data 106 in the image data 105 ob- 5 
tained by the reader unit 1 09 by using the photographing 
condition analysis unit 1 11 . On the basis of the analyzed 
result, an image correction algorithm for performing im- 
age correction of the photographed image data 107 is 
selected. 10 
[0061] More particularly, when a parameter for the in- 
formation of ID = 0 indicates "automatic exposure", an 
image correction algorithm for performing an image cor- 
rection process of correcting brightness is selected so 
as to correct exposure deficiency or overexposure. On 15 
the other hand, when the parameter indicates "manual 
exposure", an image correction algorithm not for per- 
forming an image correction process regarding bright- 
ness is selected, Therefore, it can be prevented that 
brightness of the photographed image is corrected 20 
against the intention of a user at a time of photograph- 
ing. 

Step S203: 

25 

[0062] The data analysis unit 1 1 0 analyzes the infor- 
mation of ID = 1 (stroboscope information) in the photo- 
graphing condition data 106 in the image data 105 ob- 
tained by the reader unit 1 09 by using the photographing 
condition analysis unit 1 1 1 . On the basis of the analyzed 30 
result, an image correction algorithm for performing an 
image correction of the photographed image data 107 
is selected. 

[0063] More particularly, when a parameter for the in- 
formation of ID = 1 indicates "stroboscope flashing", an 35 
image correction algorithm for performing a process of 
correcting contrast is selected. On the other hand, when 
the parameter indicates "stroboscope unflashing", an 
image correction algorithm not for performing an image 
correction process regarding contrast is selected. 40 
Therefore, the optimum image correction can be per- 
formed to a photographed image obtained by a photo- 
graphing operation of flashing or unflashing the strobo- 
scope. 

45 

Step S204: 

[0064] The data analysis unit 1 1 0 analyzes the infor- 
mation of ID = 2 (white balance information) in the pho- 
tographing condition data 1 06 in the image data 1 05 ob- so 
tained by the reader unit 1 09 by using the photographing 
condition analysis unit 1 1 1 . On the basis of the analyzed 
result, an image correction algorithm for performing im- 
age correction of the photographed image data 107 is 
selected. 55 
[0065] More particularly, when a parameter for the in- 
formation of ID = 2 indicates "automatic white balance", 
an image correction algorithm for performing color bal- 
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ance correction of adjusting the photographed image 
data to an appropriate white balance is selected. On the 
other hand, when the parameter indicates "manual 
white balance", an image correction algorithm not for 
performing an image correction process regarding color 
balance is selected. Therefore, it can be prevented that 
the color balance is corrected against the intention of 
the user at a time of photographing. 

Step S205: 

[0066] The data analysis unit 110 analyzes the infor- 
mation of ID = 3 (photographing mode information) in 
the photographing condition data 1 06 in the image data 
105 obtained by the reader unit 109 by using the pho- 
tographing condition analysis unit 111. On the basis of 
the analyzed result, an image correction algorithm for 
performing image correction of the photographed image 
data 107 is selected. 

[0067] More particularly, when a parameter for the in- 
formation of ID = 3 indicates "standard", an image cor- 
rection algorithm for performing automatic image cor- 
rection of standard setting is selected. When the param- 
eter for the information of ID = 3 indicates "effect inhibi- 
tion", an image correction algorithm not for performing 
a specific image correction process is selected. When 
the parameter for the information of ID = 3 indicates 
"scenery", an image correction algorithm of increasing 
saturation which becomes more intensive than that in a 
case of "standard" is selected. When the parameter for 
the information of ID = 3 indicates "person", an image 
correction algorithm for performing an image correction 
process by which skin color in an image is preferably 
printed is selected. According to the above process, the 
optimum image correction corresponding to the scene 
to be photographed can be performed. Furthermore, it 
can be previously prevented that when a specific effect 
has been already performed (in case of "effect inhibi- 
tion") in the digital still camera 1 01 , if the image correc- 
tion is performed at a time of printing, image quality is 
further deteriorated by the double processes. 

Step S206: 

[0068] The data analysis unit 110 analyzes the pho- 
tographed image data 107 itself in the image data 105 
obtained by the reader unit 109 by using the photo- 
graphed image analysis unit 112. On the basis of the 
analyzed result, an algorithm of realizing the optimum 
condition when the photographed image data 107 is 
print-output is selected. 

[0069] Here, selection of the algorithm is performed 
under the consideration of the image correction algo- 
rithm selected in each of the steps S202 to S205. 

Step S207: 

[0070] The image correction processing unit 113 per- 
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forms an image correction process of the photographed 
image data 1 07 in accordance with the algorithm select- 
ed by the data analysis unit 110 in each of the steps 
S202 to S206. 

Step S208: 

[0071 ] The print data conversion unit 1 1 4 converts the 
photographed image data 1 07 which was processed in 
the image correction processing unit 113 into data of 
which format can be printed by the printer 115. 

Step S209: 

[0072] The printer 1 1 5 print-outputs the photographed 
image data 107 (data to which a conversion process 
was performed in the print data conversion unit 114), 
which was processed as described above in the image 
processing apparatus 108. 

[0073] According to the above present embodiment, 
a precise automatic image correction process utilizing 
he photographing condition data 106 of indicating the 
photographed image data 107 and a photographing 
condition thereof can be realized when the photo- 
graphed image data 1 07 is print-output. Therefore, it be- 
comes possible to provide a high quality print-output re- 
juit (printed result of a photographic image) of reflecting 
nc intention of a user at a time of photographing. 
[0074] As to the photographing condition data 106 : it 
is not limited to the various information as shown in Fig. 
'/ du may be information which can specify the intention 
of me user at a time of photographing or a photograph- 
ing scene. Furthermore, for example, information of in- 
dicating the characteristic at a time of obtaining the pho- 
tographed image can be also utilized as the photographi- 
ng condition data 106. 

[0075] As to the content of the image correction proc- 
ess performed on the basis of the analyzed result of the 
photographing condition data 106, it may be the opti- 
mum image correction process corresponding to the 
characteristic or the like of the printer 115 used in per- 
forming print output but it is not limited to the above proc- 
ess 

[0076] Furthermore, in the present embodiment, 
when the photographing condition information regard- 
ing the exposure mode indicates "manual exposure"., 
tnc image correction algorithm not for performing the im- 
age correction process regarding brightness is selected. 
Alternatively, it is possible to weaken the effect of the 
image correction process regarding brightness as com- 
pared with the case of "automatic exposure". This is sim- 
ilar for other parameters. 

[0077] Furthermore, the present invention is not lim- 
ited to the present embodiment, but various modifica- 
tions can be performed within a range of not exceeding 
substance of the present invention. 



(Second Embodiment) 

[0078] In the present embodiment, format data of the 
image data 105 is reformed to format data shown in Fig. 
5 4 in the image printing system 1 00 of Fig. 1 . 

[0079] Incidentally, only the structure and the opera- 
tion different from those in the first embodiment will be 
concretely explained in the present embodiment. 
[0080] Concretely, the image data 105 is structured 
10 by a tag area 1 06a being a recording area of the photo- 
graphing condition data 106 and a photographed image 
data area 107a being a recording area of the photo- 
graphed image data 107 as shown in Fig. 4 similar to 
the case of the first embodiment. 
15 [0081 ] In the tag area 1 06a of the image data 1 05, the 
photographing condition data 106 is recorded in a por- 
tion of offsetting a predetermined data amount form a 
head of the area. The photographing condition data 
1 06a (photographing condition information of the digital 
still camera 101) corresponds to data regarding infor- 
mation of setting a correction effective function or the 
like in addition to exposure, a stroboscope, white bal- 
ance and a photographing mode, and format of the data 
can be held in common between the digital still camera 
1 01 being a data input side and the printer 1 1 5 being a 
data output side. 

[0082] A point different from that in the first embodi- 
ment is that the information of setting the correction ef- 
fective function is to be included for the photographing 
condition data 106. 

[0083] The information of setting the correction effec- 
tive function is indicated by ID = 0 (offset = n). For ex- 
ample, when an image correction process in case of 
print-outputting the photographed image data 1 07 is in- 
hibited in the image processing apparatus 108, a pa- 
rameter "0" indicating "inhibition" is set for the informa- 
tion of ID = 0. On the other hand, when the image cor- 
rection process in case of print-outputting the photo- 
graphed image data 107 is made to be effective in the 
image processing apparatus 108, a parameter "1" indi- 
cating "effective" is set for the information of ID = 0. 
[0084] By providing such the parameters for the infor- 
mation of ID = 0, it can be prevented that image quality 
is deteriorated by the double processes if the image cor- 
rection is performed in the image processing apparatus 
108 when image data, to which a specific effective cor- 
rection has been already performed in the digital still 
camera 101 at a time of photographing, is print-output 
by the printer 115. 

[0085] As to information thereafter continued from in- 
formation of ID = 1 , ID = 1 (offset = n + 1 ) indicates in- 
formation regarding exposure. 

[0086] Information of ID = 2 (offset = n + 2) indicates 
information regarding a stroboscope. 
[0087] Information of ID = 3 (offset = n + 3) indicates 
information regarding white balance. 
[0088] Information of ID = 4 (offset = n + 4) indicates 
information regarding a photographing mode. 
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[0089] The details of the information from ID = 1 to ID 
= 4 are the same as those in the first embodiment. 
[0090] Fig. 5 shows an operation of the image 
processing apparatus 108 in the present embodiment 
by a flow chart. 

[0091] In the flow chart shown in Fig. 5, identical ref- 
erence symbols are given to steps which perform the 
same processes as those in the flow chart (a flow chart 
indicating an operation of the image processing appa- 
ratus 108 in the first embodiment) shown in Fig. 3, and 
the detailed description thereof will be omitted. 
[0092] In the present embodiment, it is structured to 
add a process to be performed in a step S300 to the 
operation performed in the first embodiment. 

Step 300: 

[0093] First, similar to the first embodiment, when the 
image data 105 is read by the reader unit 109 (step 
S201), the data analysis unit 110 analyzes the informa- 
tion of ID = 0 (effective function setting information) in 
the photographing condition data 106 in the image data 
105 obtained by the reader unit 109 by using the pho- 
tographing condition analysis unit 111. On the basis of 
the analyzed result, it is discriminated if a parameter in- 
dicates "effective" or "inhibition". 

[0094] As a result of this discrimination, when the pa- 
rameter indicates "effective", the image correction proc- 
esses according to the steps S202 to S207 are per- 
formed similar to the case of the first embodiment. Then, 
a print process is performed in the steps S208 and S209. 
On the other hand, the parameter indicates "inhibition", 
the image correction processes according to the steps 
S202 to S207 are not performed, and the print process 
is performed as it is in the steps S208 and S209. 
[0095] As above : in the present embodiment, when 
the parameter for the information of ID = 0 (effective 
function setting information) in the photographing con- 
dition data 106 indicates "ineffective", the whole image 
correction processes are not performed, and the print 
process for an image is performed as it is. 
[0096] According to the present embodiment, like the 
first embodiment, it can be realized to perform a precise 
automatic image correction process utilizing the photo- 
graphed image data 107 and the photographing condi- 
tion data 106 being additional information of indicating 
a photographing condition thereof when the photo- 
graphed image data 107 is print-output. As a result, it 
can be realized to provide a high quality print-output re- 
sult (printed result of a photographic image) of reflecting 
the intention of a user at a time of photographing. 

(Third Embodiment) 

[0097] For example, the present invention is applied 
to an image printing system 400 as shown in Fig. 6. 
Since the image correction process in the first or second 
embodiment is applied to the image printing system 400 



of the present embodiment, the detailed explanation of 
the image correction process will be omitted. 
[0098] The image printing system 400 is structured to 
include a digital still camera 408, a printer 404 having a 

5 display unit 406 and a personal computer 402 having a 
display unit 403 and a printer 405. 
[0099] Communication of data between the digital still 
camera 408 and the personal computer 402 : and the 
digital still camera 408 and the printer 404 can be per- 

10 formed through a storage medium 401 . 

[0100] In the above image printing system 400, the 
digital still camera 408 has the same function as that of 
the digital still camera 101 shown in Fig.1 , and the image 
data 105 as shown in Fig. 2 or 4 is generated by a pho- 

15 tographing operation performed by a user. Then, the im- 
age data 1 05 is made to be stored in the storage medium 
401. 

[0101] As the storage medium 401 , it is not limited to 
specific one, but a memory card or a built-in memory 
20 held by the digital still camera 408, a detachable mem- 
ory card, a hard disk in the personal computer 402, or 
the like is applicable. 

[0102] The printer 404 includes an image data 
processing unit 407 having the image correcting func- 

25 tion (function of the image processing apparatus 108 
shown in Fig. 1) in the first or second embodiment. 
[0103] Thus, for example, the printer 404 reads the 
image data 105 from the storage medium 401 by the 
image data processing unit 407 (concretely, it corre- 

30 sponds to the reader unit 1 09 shown in Fig. 1 ) or directly 
reads the image data 1 05 from the memory card or the 
built-in memory held by the digital still camera 408 con- 
nected by a wired cable, an infrared communication or 
a wireless communication. 

35 [01 04] The printer 404 can display the image data 1 05 
which was processed in the image data processing unit 
407 on the display unit 406 for confirmation. 
[0105] The personal computer 402 which has the 
same function as that of the image processing appara- 

40 tus 108 shown in Fig. 1 processes the image data 105 
stored in the storage medium 401 , then print output is 
performed by the printer 405. 

[0106] The image data 105 to be processed by the 
personal computer 402 is not limited to one stored in the 

45 storage medium 401 but, for example, data stored in a 
storage medium such as the hard disk or the like in the 
personal computer 402 or stored in a storage medium 
in another personal computer (including a server or the 
like) connected to the personal computer 402 is appli- 

50 cable. As the transfer method of the image data 1 05, it 
is not limited to the method of using the storage medium 
401 but method of depending on, e.g., a card reader, a 
cable connection, the infrared communication or the 
wireless communication is applicable. In this case, the 

55 digital still camera 408 is connected to the personal 
computer 402 by thecable connection, the infrared com- 
munication or the wireless communication, and it may 
be structured that the personal computer 402 directly 
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reads the image data 1 05 from the memory card or the 
buitt-in memory held by the digital still camera 408. 
[0107] The personal computer 402 can display the 
processed image data 105 on the display unit 403 tor 
confirmation. 

[0108] Fig. 7 shows an example of a display screen 
500 displayed on the display unit 406 of the printer 404 
or the display unit 403 of the personal computer 402. 
[0109] As shown in Fig. 7, photographing condition in- 
formation (information corresponding to the photo- 
graphing condition data 106 shown in Fig. 2 or Fig. 4) 
such as exposure, a stroboscope, white balance, a pho- 
tographing mode and the like are displayed on the dis- 
play screen 500. 

[01 1 0] Especially, the display screen 500 is displayed 
when an image correction process for a print process of 
the image data 1 05 is performed in the printer 404 or 
the personal computer 402. Therefore, a user can easily 
confirm if the image correction is performed based on 
what kind of the photographing condition information 
and also easily confirm that the photographing condition 
information is correctly utilized for the image correction. 
[0111] In the third embodiment, the photographing 
condition information was to be displayed on a screen. 
However, it is not limited to this method but it may be 
indicated by an on/off operation of the light, or the like 
that the photographing condition information is correctly 
utilized. 

[0112] The present invention is not limited to the first 
to third embodiments, but various modifications can be 
performed within a range of not exceeding substance of 
the present invention. 

[0113] In the first to third embodiments, as input 
means (obtaining means) for inputting image data, the 
digital still camera is used as one example. However, it 
is not limited to this means but an input device such as 
a digital video camera, an image scanner, a film scan- 
ner, or the like is available. 

[0114] It is needless to say that the present invention 
can be achieved in a case that a storage medium storing 
the program codes of software for realizing the functions 
of a host computer and terminal devices of the first to 
third embodiments is supplied to a system or an appa- 
ratus and then a computer (or CPU or MPU) in the sys- 
tem or the apparatus reads and performs the program 
codes stored in the storage medium. 
[0115] In this case, the program codes themselves 
read from the storage medium realize the functions of 
the first to third embodiments, and the storage medium 
storing such the program codes and the program codes 
constitute the present invention. 

[0116] The storage medium for supplying the program 
codes can be, e.g., a ROM, a flexible disk, a hard disk, 
an optical disk, a magneto-optical disk, a CD-ROM, a 
CD-R, a magnetic tape, a non-volatile memory card or 
the like. 

[0117] It is needless to say that the present invention 
also includes not only a case where the functions of the 



first to third embodiments are realized by the execution 
of the program codes read by the computer, but also a 
case where an OS (operating system) or the like func- 
tioning on the computer performs all the actual process 
5 or a part thereof according to the instructions of the pro- 
gram codes, thereby realizing the functions of the first 
to third embodiments. 

[0118] Further, it is needless to say that the present 
invention includes a case where the program codes 
read from the storage medium are once written in a 
memory provided in afunction expansion board inserted 
in the computer or a function expansion unit connected 
to the computer, and a CPU or the like provided in the 
function expansion board or the function expansion unit 
performs all the actual process or a part thereof accord- 
ing to the instructions of the program codes, thereby re- 
alizing the functions of the first to third embodiments. 
[01 1 9] Fig. 8 shows a function 600 of the above com- 
puter. As shown in Fig. 8, the computer function 600 is 
structured that a CPU 601 , a ROM 602 ( a RAM 603, a 
keyboard controller (KBC) 605 for a keyboard (KB) 609, 
a CRT controller (CRTC) 606 for a CRT display (CRT) 
610 which serves as a display unit, a disk controller 
(DKC) 607 for a hard disk (HD) 611 and a flexible disk 
(FD) 612 and a network interface controller (NIC) 608 
used for connecting to a network 620 are mutually con- 
nected through a system bus 604 so that the communi- 
cation can be performed. 

[0120] The CPU 601 totally controls each of the struc- 
tural units connected to the system bus 604 by execut- 
ing the software stored in the ROM 602 or the HD 611 
or the software supplied from the FD 612. 
[0121] That is, the CPU 601 performs a control of re- 
alizing an operation to be performed in the present em- 
bodiment by reading a processing program according 
to a predetermined processing sequence from the ROM 
602, the HD 611 or the FD 612 and executing that pro- 
gram. 

[0122] The RAM 603 functions as a main memory, a 
work area or the like of the CPU 601 . The KBC 605 con- 
trols an instruction input instructed from the KB 609, a 
pointing device (not shown) or the like. The CRTC 606 
controls a display of the CRT 610. The DKC 607 controls 
an access to the HD 611 and the FD 612 which store a 
boot program, various application software, an editing 
file, a user file, a network management program, a pre- 
determined processing program in the present embod- 
iment, and the like. The NIC 608 interactively performs 
a data communication with apparatuses on a network 
620 or the system. 



Claims 

55 1 . An image processing method which performs vari- 
ous image correction processes to a photographed 
image and prints the photographed image, compris- 
ing the steps of: 
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inputting image information to which photo- 
graphing condition information is added; 
analyzing the characteristic of the input image 
information; 

performing an image correction process of im- 5 
proving image quality to the photographed im- 
age on the basis of the characteristic of the an- 
alyzed image information; 
discriminating the photographing condition in- 
formation added to the photographed image; 10 
and 

determining an image correction process to be 
performed in a step of performing the image 
correction process on the basis of the photo- 
graphing condition information discriminated in 15 
said discriminating step. 

2. A method according to Claim 1 , wherein 

it is discriminated whether the photographing 
condition information regarding exposure of the 20 
photographed image is automatic exposure or man- 
ual exposure in said discriminating step, 

if it is discriminated that it is the automatic ex- 
posure, an image correction algorithm of perform- 
ing an image correction process regarding bright- 25 
ness is selected, and 

if it is discriminated that it is the manual expo- 
sure, an image correction algorithm of not perform- 
ing the image correction process regarding bright- 
ness is selected in said determining step. 30 

3. A method according to Claim 1 , wherein 

it is discriminated whether the photographing 
condition information regarding a stroboscope flash 
of the photographed image is stroboscope flashing 35 
or stroboscope unflashing in said discriminating 
step, 

if it is discriminated that it is the stroboscope 
flashing, an image correction algorithm of perform- 
ing a process forcorrecting contrast is selected, and 40 

if it is discriminated that it is the stroboscope 
unflashing, an image correction algorithm of not 
performing the process for correcting the contrast 
is selected in said determining step. 

45 

4. A method according to Claim 1 , wherein 

it is discriminated whether the photographing 
condition information regarding white balance of the 
photographed image is automatic white balance or 
manual white balance in said discriminating step, so 

if it is discriminated that it is the automatic 
white balance, an image correction algorithm of per- 
forming color balance correction is selected, and 

if it is discriminated that it is the manual white 
balance, an image correction algorithm of not per- 55 
forming the color balance correction is selected in 
said determining step. 



5. A method according to Claim 1 , wherein 

the photographing condition information re- 
garding a photographing mode of the photographed 
image is discriminated in said discriminating step, 

if it is discriminated that it is a standard mode, 
an image correction algorithm of performing auto- 
matic image correction for standard setting is se- 
lected, 

if it is discriminated that it is a scenery mode, 
an image correction algorithm of increasing satura- 
tion which becomes more intensive than that in a 
case of the standard mode is selected, and 

if it is discriminated that it is a person mode, 
an image correction algorithm of optimizing skin 
color is selected in said determining step. 

6. A method according to Claim 1 , further comprising 
a correcting step of performing the image correction 
process determined in said determining step to the 
photographed image. 

7. A method according to Claim 6, further comprising 
a printing step of printing the photographed image 
corrected in said correcting step. 

8. A method according to Claim 1 , wherein a bright- 
ness value and a brightness distribution of the pho- 
tographed image are analyzed in said analyzing 
step. 

9. An image processing apparatus comprising: 

an image obtaining unit arranged to obtain a 
photographed image to which photographing 
condition information at a time of photograph- 
ing is added; 

a discrimination unit arranged to discriminate 
the photographing condition information; 
an analysis unit arranged to analyze the char- 
acteristic of the photographed image; 
an image correction unit arranged to perform a 
correction process of improving image quality 
of the photographed image on the basis of the 
characteristic analyzed by said analysis unit; 
and 

a determination unit arranged to determine a 
correction process to be performed by said im- 
age correction unit on the basis of the photo- 
graphing condition information analyzed by 
said analysis unit. 

10. An apparatus according to Claim 9, wherein 

said discrimination unit discriminates whether 
the photographing condition information regarding 
exposure of the photographed image is automatic 
exposure or manual exposure, 

if it is discriminated that it is the automatic ex- 
posure, said determination unit selects an image 



10 

BNSDOCID: <EP 1292108A2 I > 



♦ 



19 



EP1 292 108 A2 



20 



correction algorithm of performing an image correc- 
tion process regarding brightness, and 

if it is discriminated that it is the manual expo- 
sure, said determination unit selects an image cor- 
rection algorithm of not performing the image cor- 5 
rection process regarding the brightness. 

11. An apparatus according to Claim 9, wherein 

said discrimination unit discriminates whether 
the photographing condition information regarding io 
a stroboscope flash of the photographed image is 
stroboscope flashing or stroboscope unflashing, 

if it is discriminated that it is the stroboscope 
flashing, said determination unit selects an image 
correction algorithm of performing a process for cor- 15 
recti ng contrast, and 

if it is discriminated that it is the stroboscope 
unflashing.. said determination unit selects an im- 
age correction algorithm of not performing the proc- 
ess for correcting the contrast. 20 

12. An apparatus according to Claim 9, wherein 

said discrimination unit discriminates whether 
the photographing condition information regarding 
white balance of the photographed image is auto- 25 
matic white balance or manual white balance, 

if it is discriminated that it is the automatic 
white balance, said determination unit selects an 
image correction algorithm of performing color bal- 
ance correction, and 30 

if it is discriminated that it is the manual white 
balance, said determination unit selects an image 
correction algorithm of not performing the color bal- 
ance correction. 

35 

13. An apparatus according to Claim 9, wherein 

said discrimination unit discriminates photo- 
graphing condition information regarding a photo- 
graphing mode of the photographed image, and 

said determination unit selects an image cor- *o 
rection algorithm of performing automatic image 
correction for standard setting if it is discriminated 
that it is a standard mode, 

said determination unit selects an image cor- 
rection algorithm of increasing saturation which be- 4$ 
comes more intensive than that in a case of the 
standard mode if it is discriminated that it is a scen- 
ery mode, and 

said determination unit selects an image cor- 
rection algorithm of optimizing skin color if it is dis- 50 
criminated that it is a person mode. 

14. An apparatus according to Claim 9, further compris- 
ing a correction unit for performing the image cor- 
rection process determined by said determination 55 
unit to the photographed image. 

15. An apparatus according to Claim 14, further com- 



prising a print unit for printing the photographed im- 
age corrected by the correction unit. 

16. An apparatus according to Claim 9, wherein said 
analysis unit analyzes a brightness value and a 
brightness distribution of the photographed image. 

17. An image processing method comprising the steps 
of: 

obtaining image information which includes 
photographing condition data indicating wheth- 
er or not exposure or white balance is automat- 
ically determined when a photographing oper- 
ation is performed by a digital still camera, and 
photographed image data; and 
performing a correction process to the photo- 
graphed image data by analyzing the photo- 
graphing condition data and the photographed 
image data, 

wherein said correcting step includes a step 
of performing a correction process of not performing 
correction regarding brightness of an image or color 
balance when the photographing condition data in- 
dicates that the exposure or the white balance is not 
automatically determined. 

18. An image processing apparatus comprising: 

an obtaining unit arranged to obtain image in- 
formation which includes photographing condi- 
tion data indicating whether or not exposure or 
white balance is automatically determined 
when a photographing operation is performed 
by a digital still camera, and photographed im- 
age data; and 

a correction process unit arranged to perform 
a correction process to the photographed im- 
age data by analyzing the photographing con- 
dition data and the photographed image data, 

wherein said correction process unit performs 
a correction process of not performing correction re- 
garding brightness of an image or color balance 
when the photographing condition data indicates 
that the exposure or the white balance is not auto- 
matically determined. 

1 9. A computer-readable storage medium which stores 
a program for causing an image processing appa- 
ratus to perform the steps of: 

inputting image information to which photo- 
graphing condition information is added; 
analyzing the characteristic of the input image 
information; 

performing an image correction process of im- 
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proving image quality to a photographed image 
on the basis of the characteristic of the ana- 
lyzed image information; 
discriminating the photographing condition in- 
formation added to the photographed image; 5 
and 

determining an image correction process to be 
performed in a step of performing the image 
correction process on the basis of the photo- 
graphing condition information discriminated in 10 
said discriminating step. 

20. A computer-readable storage medium which stores 
a program for causing an image processing appa- 
ratus to perform the steps of: 15 

obtaining image information which includes 
photographing condition data indicating wheth- 
er or not exposure or white balance is automat- 
ically determined when a photographing oper- 20 
ation is performed by a digital still camera, and 
photographed image data; and 
performing a correction process to the photo- 
graphed image data by analyzing the photo- 
graphing condition data and the photographed 25 
image data, 

wherein said correcting step includes a step 
of performing a correction process of not performing 
correction regarding brightness of an image orcolor 30 
balance when the photographing condition data in- 
dicates that the exposure or the white balance is not 
automatically determined. 

21 . A data structure for image data recorded by a cam- 35 
era, the data structure comprising: 

an image data portion for storing image data; 
and 

a tag area for storing metadata relating to the *o 
camera settings used to obtain the image data. 

22. A method of recording an image comprising record- 
ing image data in a data structure, and recording 
metadata in the data structure relating to the image. 45 

23. A method as claimed in claim 22 including inputting 
user preference data representative of user prefer- 
ence for subsequent processing of the image data 
and recording the user preference data in the meta- so 
data. 
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